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The  drive  for  greater  efficiency  in  the  Department  of  Defense  has  so  far  been 
characterized  by  centraliy  directed  efforts  such  as  A-76  competitive  sourcing 
of  commerciai  activities.  The  next  stage  of  improving  defense  management 
requires  decentraiizing  the  pursuit  of  efficiency  on  a  framework  of  strategic 
pianning,  cost  accounting,  and  performance  measurement.  A  survey  of  some 
pilot  efforts  to  establish  and  use  these  business  techniques  in  DoD  organizations 
finds  promising  beginnings  in  all  three  areas. 


Defense  leaders  are  trying  to  make 
their  vast  domain  more  efficient. 
The  most  visible  measures  have 
been  business  initiatives,  such  as  the  “com¬ 
petitive  sourcing”  campaign,  centrally 
driven  from  the  Office  of  the  Secretary  of 
Defense.  The  thesis  of  this  article  is  that 
the  next  stage  of  improving  defense  man¬ 
agement  requires  decentralizing  the  pur¬ 
suit  of  efficiency  on  a  framework  of  stra¬ 
tegic  planning,  cost  accounting,  and  per¬ 
formance  measurement.  I  have  surveyed 
some  pilot  efforts  to  establish  and  use 
these  business  techniques  in  Department 
of  Defense  (DoD)  organizations  and  found 
promising  beginnings  in  all  three  areas. 

Defense  Outsourcing  and  the 
Revolution  in  Business  Affairs 

The  Office  of  the  Secretary  of  Defense 
(OSD)  seeks  a  “revolution  in  defense 


business  affairs”  to  create  faster,  more 
agile,  and  more  efficient  support  opera¬ 
tions  to  complement  dominant  combat 
forces  and  to  free  resources  for  continu¬ 
ing  modernization  (Cohen,  1997).  Defense 
reform  initiatives  fall  into  four  general 
areas:  reengineering  to  adopt  modem  busi¬ 
ness  practices;  consolidating  to  remove 
redundancy;  competing  so  that  market 
mechanisms  can  improve  quality,  cost, 
and  responsiveness;  and  eliminating 
excess  support  structures  (DoD,  2000). 

A  Defense  Science  Board  (DSB)  Task 
Force  on  Outsourcing  and  Privatization 
report  published  in  1996  estimated  that  in 
1994,  640,000  military  and  civilian  de¬ 
fense  employees  were  performing  func¬ 
tions  “generally  available  in  the  private 
sector”  (Office  of  the  Secretary  of  De¬ 
fense  for  Acquisition  and  Technology, 
1996).  It  went  on  to  calculate  that  if  half 
these  positions  were  converted  to  contract 
at  an  average  30  percent  cost  reduction. 
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Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  0MB  control  number. 
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then  annual  savings  could  range  from  $7 
billion  to  $12  billion  by  2002.  Subse¬ 
quently,  DoD  committed  itself  to  evaluat¬ 
ing  the  entire  defense  military  and  civil¬ 
ian  workforce  to  identify  functions  appro¬ 
priate  for  outsourcing  (Cohen,  1997). 

The  current  procedures  for  determin¬ 
ing  whether  a  federal  function  should  be 
converted  to  contract  are  described  in 
Office  of  Management  and  Budget  (0MB) 
Circular  A-76,  “Commercial  Activities,” 
first  published  in  1966  and  most  recently 
revised  in  1996. 

In  the  summer  of  1997,  the  Services  and 
defense  agencies  under  OSD  guidance  set 
target  numbers  of  civilian  and  military 
spaces  to  be  competed  under  A-76  rules. 
At  the  same  time,  they  built  the  budget 
program  for  the  years  1998-2003  antici¬ 
pating  personnel  space  and  cost  reductions 
consistent  with  the  record  of  earlier  com¬ 
mercial  activities  efforts.  OSD  assured  the 
Services  that  their  overall  budgets  would 
not  be  reduced  as  a  result  of  outsourcing 
savings  (Kaminski,  1997).  Through  fis¬ 
cal  year  2000,  DoD  has  reviewed  or  is 
currently  reviewing  for  potential  out¬ 
sourcing  18 1,000  positions,  twice  as  many 
as  were  reviewed  in  the  previous  17  years. 
The  department  expects  a  total  of  245,000 
to  be  reviewed  by  2005  (Cohen,  2000). 

Initial  Reactions  to  Outsourcing 

Although  the  assumed  savings  have 
already  been  factored  into  the  defense 
program,  actual  savings  are  harder  to  pin 
down.  Generally,  private  sector  offerors 
have  won  60  percent  of  the  competitions 
(Ferris,  1999).  Estimates  of  government 
costs,  both  in  the  historic  baseline  before 
an  A-76  competition  and  projected  for  an 


in-house  most  efficient  organization 
(MEO),  are  subject  to  the  inaccuracies  of 
government  accounting  systems.  Audits 
sampling  the  pre- 1996  competitions  iden¬ 
tified  average  cost  savings  of  20-30  per¬ 
cent,  whether  or  not  the  activity  was  con¬ 
tracted  out  or  retained  in-house.  Gener¬ 
ally  these  were  snapshot  results  of  the  bid 
comparisons. 

Afterward,  both  contracts  and  govern¬ 
ment  MEOs  have  been  modified  to  adjust 
to  changing  missions  and  occasionally  to 
restore  tasks  mistakenly  omitted  from  the 
performance  work  statement  (Defense 
Eogistics  Agency,  undated).  A  recent  Gen¬ 
eral  Accounting  Office  (GAO)  report 
(1999)  questions  whether  assumed  sav¬ 
ings  figures  may  be  overly  optimistic  in 
not  sufficiently  accounting  for  the  costs 
of  administering  competitions  and  sepa¬ 
rating  displaced  government  workers.  It 
further  reports  concerns  of  service  offi¬ 
cials  that  they  may  have  run  out  of  spaces 
to  compete  short  of  meeting  their  agreed 
quotas. 

Although  the  outsourcing  effort  will 
continue  and  it  is  early  to  make  an  as¬ 
sessment,  certain  features  emerge.  The 
defense  outsourcing  effort  has  been  im¬ 
posed  from  the  top  on  an  aggressive  time¬ 
table.  Although  the  DSB  recommended 
making  use  of  waivers  and  large-scale 
conversions,  the  Services  have  relied 
more  on  numerous  small-scale  A-76  com¬ 
petitions.  Outsourcing  appears  to  have 
generated  some  savings  and  allowed  bud¬ 
get  reallocations,  although  the  department 
needed  a  top-line  increase  in  order  to  hit 
its  modernization  target  of  $60  billion  in 
the  2001  budget  submission  (Cohen, 
2000).  Has  defense  efficiency  been  in¬ 
creased,  or  have  OSD  and  the  Services 
simply  found  a  new  rationale  for  cutting 
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money  and  personnel  spaces  from  opera¬ 
tions  and  maintenance  (O&M)  budget 
lines?  Without  better  systems  to  account 
for  costs  and  to  measure  performance, 
we  have  a  hard  time  answering. 

Efficiency  as 

Defense  Business  Objective 


Government  efficiency,  like  that  in  the 
commercial  sector,  can  be  defined  as  the 
ratio  of  outputs  to  inputs;  however,  the 
general  lack  of  markets  to  assign  value  to 
public  sector  outputs  makes  the  process 
more  difficult.  Public  sector  pursuit  of 
efficiency  requires: 

•  strategic  planning  to  infer  required 
outputs  from  politically  determined 
outcomes  and  to  make  tradeoffs  be¬ 
tween  the  desired  outputs  to  determine 
target  levels  of  service; 

•  accounting  that  allows  quantifying  the 
input  cost  that  contributes  to  an  output; 

•  quantitative  measures  of  output  goals 
and  performance;  and 

•  motivation  and  resources  to  establish 
the  management  systems  and  to  make 
the  choices  that  maximize  efficiency. 

On  examination,  the  modem  business 
practices  directed  by  the  Defense  Reform 
Initiatives  (DoD,  2000),  however  worthy, 
turn  out  to  be  specific  actions  for  Services 
and  defense  agencies  rather  than  establish¬ 
ment  of  broader  management  systems  or 
goals.  Although  they  receive  less  public¬ 
ity,  more  general  improvements  in  busi¬ 
ness  management,  changes  in  the  way 


defense  organizations  set  their  goals, 
resource  functions,  and  measure  their 
performance,  are  also  occurring  in  DoD. 
As  an  alternative  to  centralized  direction 
of  specific  actions  such  as  the  competitive 
sourcing  experience  of  the  past  four  years, 
I  looked  around  DoD  for  evidence  of  three 
elements  of  decentralized  government 
efficiency-seeking:  strategic  planning, 
cost  accounting,  and  performance  mea¬ 
surement.  I  also  explored  their  application 
toward  sourcing  decisions. 

Strategic  Planning 


Strategic  planning  takes  a  rational  look 
at  an  organization’s  external  environment 
and  its  mission  and  vision,  values  and 
beliefs,  customers  and  stakeholders,  prod¬ 
ucts  and  services,  and  long-term  goals  and 
objectives.  Strategic  planning  represents 
an  effort  to  align  activities  through  the  dif¬ 
ferent  echelons 
with  priorities 
determined  at 
the  top,  relating 
operational  and 
support  func¬ 
tions  in  a  con¬ 
sistent  way  to 
missions.  It  rep¬ 
resents  a  move  in  defense  planning  to¬ 
ward  a  capabilities-based  organization  and 
away  from  a  purely  threat-based  one.  It 
provides  a  framework  for  cost  and  per¬ 
formance  measurement  systems.  And 
finally  it  provides  an  opportunity  to  zero- 
base  the  organization  by  starting  from  ba¬ 
sics  to  justify  each  activity  and  letting 
form  follow  function. 

The  most  sweeping  management  effort 
in  DoD  today  is  the  Air  Force-wide  program 


"Government 
efficiency,  like 
that  in  the 
commercial  sector, 
can  be  defined  as 
the  ratio  of  outputs 
to  inputs...." 
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called  “strategic  planning”  (Department 
of  the  Air  Force,  2000).  At  the  Service 
level,  goals  are  based  on  the  Service  statu¬ 
tory  functions  of  organizing,  training,  and 
equipping  the  force.  The  three  goals — 
quality  people,  operational  performance, 
and  modernization — align  roughly  with 
the  two  top-end  DoD  Government  Per¬ 
formance  and  Results  Act  (GPRA)  goals: 
prepare,  and  shape  and  respond.  Mission 
essential  tasks  (METs)  line  up  under  the 
goals  as  follows  (Department  of  the  Air 
Force,  1999): 

•  Goal  1.  Quality  people: 

MET l.A.  Recruit  and  retain  the  force 
to  execute  Air  Force  core  competencies. 

MET l.B.  Educate  and  train  a  quality 
workforce. 

MET  l.C.  Enhance  the  quality  of  life 
of  our  total  force  and  their  families. 

MET  l.D.  Maintain  a  fit  and  healthy 
workforce. 

•  Goal  2.  Operational  performance: 

MET 2.  A.  Improve  mission  effective¬ 
ness  while  minimizing  risk. 

MET 2.B.  Maximize  the  efficiency  of 
operating  and  maintaining  U.S.  Air 
Force  resources. 

•  Goal  3.  Modernization: 

MET  3. A.  Maintain  and  enhance  our 
competitive  edge  hy  identifying,  de¬ 
veloping,  and  applying  innovative 
concepts,  technologies,  and  processes. 


Each  Air  Force  Major  Command 
(MajCom)  is  now  charged  to  develop  its 
own  METs,  addressing  not  only  the 
service-wide  ones  listed  above  but  also  ap¬ 
propriate  METs  derived  from  the  six  Air 
Force  core  competencies.  These  are  air 
and  space  superiority,  global  attack,  rapid 
global  mobility,  precision  engagement, 
information  superiority,  and  agile  combat 
support.  Wing-level  METs  are  to  address 
appropriate  core  competencies  but  not  the 
three  Service-level  goals.  METs  at  all  lev¬ 
els  have  performance  measures  and  asso¬ 
ciated  standards  of  performance.  Support¬ 
ing  tasks  are  activities  that  contribute  to 
METs  without  being  essential  in  them¬ 
selves.  They  too  have  performance  mea¬ 
sures  and  standards.  The  overall  process 
brings  under  one  structure  many  existing 
systems  to  measure  performance  in  terms 
of  equipment  availability,  unit  capabili¬ 
ties,  and  support  system  effectiveness. 

The  Air  Force  strategic  plan  envisions 
a  cycle  of  continuous  improvement 
through  periodic  assessment,  improve¬ 
ment  planning,  and  execution.  Its  overall 
thmst  is  effectiveness  in  meeting  standards 
rather  than  efficiency  in  producing  out¬ 
puts.  Although  probably  not  intended  as 
a  system  for  efficiency  improvement,  it 
could  be  part  of  one.  It  will  help  ensure 
that  outputs  relate  to  desired  outcomes, 
and  it  should  help  identify  for  elimination 
functions  that  add  no  value. 

Although  the  Air  Force  strategic  plan 
documentation  does  not  say  so,  the  iden¬ 
tification  of  core  competencies  and  essen¬ 
tial  tasks  implies  that  support  functions 
may  be  more  appropriate  for  outsourcing. 
By  aligning  functions  and  performance 
measurement  throughout  DoD,  it  creates 
a  structure  that  could  potentially  be  used 
for  assessing  at  various  levels  alternative 
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means  of  mission  performance.  If  organi¬ 
zations  could  associate  costs  with  the  level 
and  means  of  task  performance,  then  the 
system  would  support  pursuing  efficiency. 

The  Navy  is  putting  in  place  a  system 
called  “strategic  sourcing”  (Department  of 
the  Navy,  2000),  which  more  directly  ad¬ 
dresses  the  efficiency  challenge.  The  Navy 
faces  the  problem  common  to  all  the  ser¬ 
vices,  that  A-76  competitions  alone  are  not 
generating  the  savings  that  were  already 
projected  in  the  summer  of  1997  budget 
decisions.  By  committing  to  a  broader 
search  for  efficiency  opportunities,  the 
Navy  has  received  from  OSD  permission 
to  count  against  competitive  sourcing  tar¬ 
gets  savings  achieved  through  reen¬ 
gineering  even  of  activities  that  are 
formally  exempt  from  A-76  competitions. 

In  a  sense  strategic  sourcing  picks  up 
where  processes  like  the  Air  Force  strate¬ 
gic  plan  leave  off.  It  is  intended  to  be  ap¬ 
plied  to  an  entire  function  or  organization, 
including  all  activities  whether  in-house 
or  contracted,  inherently  governmental, 
military  essential,  or  restricted.  The  first 
step  is  to  validate  the  requirement,  which 
is  best  done  after  a  rigorous  strategic  plan¬ 
ning  approach  like  the  Air  Force  strategic 
plan  has  derived  essential  tasks  from  top- 
level  missions.  Unneeded  activities  or 
parts  of  activities  must  be  eliminated. 

The  strategic  sourcing  process  then 
examines  whether  any  commercial  activi¬ 
ties  (as  defined  by  0MB  A-76)  can  be 
severed  from  exempt  activities.  Since 
there  is  room  for  judgment  in  determin¬ 
ing  exemptions,  especially  for  military 
considerations,  this  analysis  needs  to  be 
performed  very  broadly.  For  example, 
exempting  activities  because  spaces  are 
needed  for  rotating  service  members  from 
sea  or  foreign  duty  can  only  be  done  after 


examining  billets  across  a  major  command 
or  perhaps  across  the  entire  Service.  De¬ 
termining  militarily  essential  functions 
implies  a  Service-wide  identification  of 
core  activities,  not  a  local  decision.  Stra¬ 
tegic  sourcing  explicitly  calls  for  consid¬ 
ering  an  A-76  cost  comparison  waiver, 
privatization,  and  other  alternatives  that 
would  shift  the  functions  to  the  private 
sector. 

The  key  feature  of  the  proposal  is  that 
activities  or  parts  of  activities  exempted 
from  commercial  activities  consideration 
are  also  required  to  reengineer  themselves 
to  an  MEO  as  if  they  were  subject  to  A- 
76  competition. 

The  Navy  uses 
the  term  “func¬ 
tionality  assess¬ 
ment”  to  refer 
to  this  business 
reengineering 
process.  It  envi¬ 
sions  dramati¬ 
cally  rebuilding 
an  existing  or¬ 
ganization  over 
the  course  of  6  to  12  months  through  a 
systematic  process  of  analyzing  and  re¬ 
structuring.  After  the  reengineering  is  com¬ 
plete,  ongoing  total  quality  management 
is  expected  to  maintain  efficiency  and  en¬ 
sure  that  performance  goals  are  met.  The 
functionality  assessment  procedures  also 
highlight  activity-based  costing  as  an 
element  of  analysis. 

Cost  Accounting 


Activity-based  costing  (ABC)  refers  to 
determining  the  total  cost  of  producing  a 
specific  product  or  service  as  opposed  to 


"The  Navy  is 
putting  in  place 
a  system  called 
'strategic  sourcing' 
(Department  of  the 
Navy,  2000),  which 
mere  directly 
addresses  the 
efficiency 
challenge." 
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tracking  the  cost  of  unrelated  inputs  that 
support  many  outputs.  The  biggest  chal¬ 
lenge  in  establishing  ABC  is  allocating 
overhead  costs,  but  organizations  must 
also  establish  standardized  lists  of  outputs 
and  systems  for  assigning  all  costs  to 
them.  A  related  term,  activity-based  man¬ 
agement  (ABM),  refers  to  using  ABC  to¬ 
gether  with  performance  measurement 
and  other  techniques  continuously  to 
pursue  greater  efficiency. 

Cost  accounting  reform  has  long  been 
recognized  as  an  essential  element  of  de¬ 
fense  efficiency  improvement.  Congress 
has  provided  encouraging  legislation, 
ranging  from  the  Chief  Financial  Offic¬ 
ers  (CFO)  Act  of  1990  to  the  Government 
Performance  Results  Act  and  the  Federal 
Financial  Management  Improvement  Act. 

As  part  of  its  1997  National  Perfor¬ 
mance  Review  submission,  DoD  set  itself 
the  goal  of  establishing  an  implementa¬ 
tion  plan  for  life-cycle  ABC  for  weapon 
systems  by  2000.  Later  that  year  the  goal 

was  extended 
to  include  all 
activities  in  the 
department, 
not  just  weap¬ 
ons  systems.  In 
July  1999  the 
Under  Secre¬ 
tary  of  Defense 
for  Acquisi¬ 
tion,  Technology  and  Logistics,  Jacques 
Gansler  signed  a  memo  directing  the 
Services  and  defense  agencies  aggres¬ 
sively  to  pursue  ABC/ ABM  “in  mainte¬ 
nance  depots  and  everywhere  else  it  could 
be  expected  to  provide  improved  cost 
management.” 

In  response  to  the  OSD  tasking,  the 
Army  has  identified  1 1  support  functions 


for  implementing  cost  management,  in¬ 
cluding  depot  maintenance,  supply  man¬ 
agement,  ordnance,  information  support, 
civilian  human  resources,  institutional 
training,  base  operations  and  support, 
research  and  development  laboratories, 
test  and  evaluation  contracting,  and  acqui¬ 
sition  (Army  Managerial  Costing  Steering 
Committee,  1999).  The  Army  plan  recog¬ 
nizes  the  far-reaching  effect  of  ABC  and 
necessary  links  to  Planning,  Program¬ 
ming,  and  Budgeting  System  (PPBS)  and 
other  cur-rent  management  systems.  The 
plan  features  centrally  funded  purchases  of 
account-ing  software  and  training  to  ease 
transition  and  standardize  procedures,  but 
the  effort  identifies  decentralizing  oppor¬ 
tunities  for  creative  improvement  as  a 
major  benefit. 

The  Army  has  for  several  years  endorsed 
activity-based  costing  as  a  local  manager’s 
tool.  A  pilot  ABC/ABM  program  began  in 
1996  at  five  installations  of  XVIII  Airborne 
Corps  and  in  1997  expanded  to  the  rest  of 
Army  Forces  Command  (U.S .  Army  Forces 
Command,  1999).  The  program  seeks  to 
establish  a  continuous  cycle  for  improve¬ 
ment  encompassing  process  evaluation  and 
generating,  selecting,  and  implementing  al¬ 
ternative  solutions.  General  objectives  in¬ 
clude  improving  timeliness,  cost,  and  qual¬ 
ity  of  services. 

The  five  installations  of  XVIII  Airborne 
Corps  have  succeeded  in  implementing 
ABC  across  eight  base  support  functions 
including  logistics,  personnel  manage¬ 
ment,  community  activities,  training  man¬ 
agement,  public  works,  information  man¬ 
agement,  and  resource  management.  The 
work  involved  adapting  computer  ac¬ 
counting  models  to  each  installation,  train¬ 
ing  specialists  and  managers  and  applying 
cost  information  to  management  decisions. 


"Cost  accounting 
reform  has  long 
been  recognized 
as  an  essential 
element  of  defense 
efficiency 
improvement." 
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The  Directorate  of  Logistics  at  Fort  Riley, 
KS,  claimed  a  34  percent  reduction  in 
manpower  and  a  $6  million  reduction  in 
operating  costs  in  its  first  year  of  ABC/ 
ABM  management  (LaGrange,  1999). 

Performance  Measurement 


The  Government  Performance  Results 
Act  (GPRA)  of  1993  provides  the  current 
framework  for  measuring  output  perfor¬ 
mance  in  federal  agencies.  It  seeks  to 
move  the  focus  of  government  away  from 
inputs  and  structure  toward  results,  urging 
agencies  to  (GAO,  1996): 

•  define  missions  and  desired  outcomes; 

•  align  their  activities,  core  processes,  and 
resources  to  support  these  outcomes; 

•  establish  complete,  accurate,  and  con¬ 
sistent  measures  of  program  perfor¬ 
mance;  and 

•  use  performance  data  to  identify  short¬ 
falls,  set  improvement  goals,  and 
improve  organizational  processes. 

After  the  act  was  first  passed  in  1993, 
DoD  designated  seven  GPRA  perfor¬ 
mance  measurement  pilots  (Maroni, 
1998): 

•  the  Army  Audit  Agency ; 

•  the  Army  Research  Laboratory; 

•  the  Air  Combat  Command  (ACC); 

•  a  carrier  battle  group  in  the  Atlantic 
Fleet; 


•  the  Defense  Commissary  Agency; 

•  Army  Corps  of  Engineers  Civil  Works 

operations  and  maintenance;  and 

•  the  Defense  Logistics  Agency  (DLA). 

The  formal  DoD  pilot  program  has  been 
discontinued  because  OSD  views  GPRA 
only  as  a  department-level  requirement. 
Nevertheless,  I  surveyed  the  current  sta¬ 
tus  of  the  seven  pilots  to  get  an  idea  of  the 
potential  of  performance  measurement  in 
DoD.  Selected  results  follow. 

Army  Research  Laboratory 

The  Army  Research  Laboratory  ( ARL) 
was  activated  in  early  1993  through  a  con¬ 
solidation  of  predecessor  organizations,  so 
the  acting  director  at  the  time  seized  the 
opportunity  to 
be  a  GPRA  pi¬ 
lot  in  order  pro¬ 
mote  new  man¬ 
agement  prac¬ 
tices  (Brown, 

1998).  Measur¬ 
ing  the  perfor¬ 
mance  and  effi¬ 
ciency  of  research  and  development 
(R&D)  activities  is  challenging  in  the  pri¬ 
vate  sector  as  well  as  in  government  be¬ 
cause  research  outcomes  are  not  usually 
known  in  advance,  there  is  a  high  per¬ 
centage  of  negative  findings,  and  there  is 
a  long  lag  between  inputs  and  outputs. 

Performance  measurement  at  ARL  falls 
into  three  areas:  relevance,  productivity, 
and  quality.  The  laboratory  uses  several 
measurement  techniques.  ARL  contracts 
with  the  National  Academies  of  Science 
and  Engineering  for  an  independent 
technical  assessment  board  and  advisory 


"Performance 
measurement  at 
ARL  falls  into  three 
areas:  relevance, 
productivity,  and 
quality." 
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panels  of  outside  research  professionals 
to  review  one  third  of  the  ARL  technical 
program  each  year  for  quality.  ARL  uses 
about  50  quantifiable  measures  of  produc¬ 
tivity,  with  the  director  tracking  some  14 
closely  and  using  them  to  set  performance 
goals  for  his  senior  managers. 

Three  customer  response  tools  provide 
the  most  useful  measures  of  relevance  and 
productivity.  ARL  polls  all  its  reimburs¬ 
ing  customers  for  assessments  of  specific 
research  products.  The  laboratory  direc¬ 
tor  requires  division  directors  to  respond 
to  the  infrequent  unfavorable  responses 
within  a  week  of  receipt.  ARL  also  con¬ 
sults  a  board  of  directors  comprising  the 
technical  directors  of  the  Army  Material 
Command  (AMC)  organizations,  which 
are  ARL’s  principal  customers.  Finally, 
there  is  a  Stakeholders’  Advisory  Board 
of  three-star-rank  Army  leaders  under  the 

chairmanship 
of  the  Com¬ 
manding  Gen¬ 
eral  of  AMC. 
They  meet  an¬ 
nually  to  en¬ 
sure  that  ARL 
is  coupled  to 
the  Army  vi¬ 
sion,  respon¬ 
sive  to  senior 
leadership,  and  provide  the  technologies 
that  the  future  Army  will  need. 

The  ARL  performance  evaluation  con¬ 
struct  has  been  useful  to  ensure  visibility 
of  the  research  program  and  response  to 
Army  needs.  It  is  integral  to  accountabil¬ 
ity  of  the  laboratory  as  a  whole  and  the 
senior  leadership  as  individuals.  The  quan¬ 
tified  metrics  portion  is  considered  the 
least  useful  of  the  triad,  but  it  has  contrib¬ 
uted  to  boosting  specific  items  such  as 


publication  of  referred  papers  and  number 
of  staff  holding  doctorates.  While  Circu¬ 
lar  A-76  specifically  exempts  R&D  from 
outsourcing  competition,  the  Stakehold¬ 
ers’  Advisory  Board  in  1998  approved 
contracting  out  all  ARL  support  functions, 
reserving  as  specific  core  competencies 
the  management  and  conduct  of  R&D 
itself. 

Atuntic  Fleet  Bahle  Group 

Three  Army  support  agencies  partici¬ 
pated  in  the  performance  measurement  pi¬ 
lot  program;  participants  from  the  other 
services  were  combat  commands.  The  Navy 
element  was  the  Atlantic  Fleet’s  George 
Washington  Carrier  Battle  Group  (GWBG) 
(Pearsall  &Hill,  1999).  The  GWBG  pilot 
established  several  objectives: 

•  Determine  feasibility  of  measuring 
battle  group  mission  performance. 

•  Provide  lessons  learned  and  recom¬ 
mendations. 

•  Develop  a  daily  mission  readiness  as¬ 
sessment  system  to  integrate  “stove¬ 
pipes”  of  readiness  data  for  the  battle 
group  commander. 

The  model  measured  seven  prescribed 
critical  tasks  for  the  carrier  battle  group — 
air  dominance,  maritime  superiority, 
power  projection,  surveillance  and  intel¬ 
ligence,  command  and  control,  sustain¬ 
ment,  and  peacetime  presence.  For  each 
critical  task  it  identified  prescribed  sub¬ 
tasks,  each  in  turn  supported  by  no  more 
than  eight  performance  indicators.  For 
example  the  critical  task  of  “seize  and 
maintain  control  of  designated  airspace” 
included  three  subtasks  of  which  one  was 


"The  ARL  perfor¬ 
mance  evaluation 
construct  has  heen 
useful  to  ensure 
visihility  of  the 
research  program 
and  responsiveness 
to  Army  needs." 
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“detect,  monitor,  and  maintain  readiness 
to  intercept  aerial  contacts.”  Subject  mat¬ 
ter  experts  reached  consensus  on  the  seven 
performance  measures  of  task  perfor¬ 
mance  (for  example,  “percent  ship  elec¬ 
tronic  intercept  receivers  fully  operative”). 
The  entire  system  included  a  total  of  280 
performance  indicators,  some  of  which 
appear  in  more  than  one  critical  task. 
Given  staff  workload  concerns,  no  new 
data  collection  requirements  were  im¬ 
posed  on  the  battle  group  staff.  Perfor¬ 
mance  measures  used  “stove-piped”  data 
already  being  collected  as  part  of  existing 
programs  but  not  integrated  into  a  mis¬ 
sion  performance  perspective.  The  project 
created  a  Microsoft  Office-based  system 
for  assembling  and  presenting  the  data. 

On  review,  Atlantic  Fleet  leadership 
decided: 


a  fiscal  year  2000  battle  group  deploy¬ 
ment.  Full  implementation  of  the  ABC/ 
ABM  concept  will  depend  on  the  results 
of  the  next  phase.  Project  personnel  be¬ 
lieve  that  the  prototype  offers  the  possi¬ 
bility  to  address  currently  unanswerable 
questions,  such  as: 

•  Where  should  readiness  dollars  be 
spent  for  the  greatest  increase  in 
effectiveness? 

•  Where  are  readiness  dollar  tradeoffs? 

•  What  is  the  marginal  readiness  rate  of 
return  for  an  individual  system? 

•  Which  systems  should  be  donors  and 
which  ones  recipients  of  resource 
shifts? 


•  to  continue  testing  the  performance 
measurement  model  on  three  subse¬ 
quent  Atlantic  Fleet  carrier  battle 
groups; 

•  to  develop  a  comparable  prototype 
model  for  an  Amphibious  Readiness 
Group  (ARC)  (USN/USMC  elements); 
and 

•  to  test  the  feasibility  of  linking  mis¬ 
sion  performance  to  activities-based 
cost  accounting  as  groundwork  for  po¬ 
tentially  developing  a  comprehensive 
ABC/ ABM  system. 

The  cost  linkage  has  been  successfully 
demonstrated  in  a  controlled  pilot  project 
using  actual  Battle  Group  Air  Wing  per¬ 
formance  and  cost  data,  demonstrating  at 
least  the  feasibility  of  full  implementation. 
A  follow-on  dynamic  test  is  scheduled  for 


Defense  Logistics  Agency 

The  Defense  Logistics  Agency  (DLA) 
measures  performance  in  a  variety  of 
documents  including  its  performance  con¬ 
tract  with  OSD, 
a  strategic  plan, 
a  performance 
plan  and  busi¬ 
ness  area  long- 
range  plans.  The 
fiscal  year  1997 
DLA  perfor¬ 
mance  report 
identifies  35 
performance  targets,  for  all  but  two  of 
which  measurable  objectives  were  estab¬ 
lished.  The  list  included  targets  for  cus¬ 
tomer  satisfaction  and  for  the  timeliness, 
effectiveness,  and  cost  of  various  agency 
operations.  Subordinate  elements  of  DLA 
have  their  own  performance  plans,  whose 
performance  measures  support  the 


"Project  personnel 
believe  that  the 
prelelype  offers 
the  possibility  to 
address  currently 
unanswerable 
questions...." 
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agency-level  ones.  Furthermore,  manag¬ 
ers  include  corporate  measures  in  their 
individual  performance  evaluations.  DLA 
has  refined  the  performance  measurement 
process,  working,  for  example,  to  develop 
customer-focused  metrics  that  relate  to 
customer  unit  goals  such  as  comhat 
readiness. 

The  performance  contract  responds  to 
a  January  1998  Defense  Reform  Initia¬ 
tive  Directive 
(Hamre)  for 
defense  agen¬ 
cies  to  submit 
to  the  Deputy 
Secretary  of 
Defense  con¬ 
tracts  covering 
the  period  of 
the  Future  Years  Defense  Plan,  fiscal  years 
2000-2005.  These  contracts  include: 

•  quality  of  products  and  services  to  he 
provided; 

•  measures  of  customer  satisfaction; 

•  planned  cost  of  providing  goods  and 
services; 

•  results  of  henchmarking  studies  assess¬ 
ing  reasonableness  of  planned  cost  and 
quality; 

•  planned  improvements  in  productivity ; 

•  planned  steps  to  correct  deficiencies  in 
performance  metrics; 

•  discrete  actions  that  agencies  commit 
to  accomplish;  and 


•  goals  for  multiyear  actions  with  mile¬ 
stones  and  measures  of  cost  and  other 

efficiencies. 

The  measures  and  targets  in  the  current 
DLA  contract  address  customer  satisfac¬ 
tion,  efficiency,  and  timeliness,  similarly 
to  the  performance  plan. 

DLA  aims  to  be  efficient  and  to  achieve 
performance  levels  that  meet  customer 
needs.  The  performance  contract  and  other 
plans  highlight  efficiency  as  a  goal.  Fur¬ 
thermore,  DLA  itself  operates  in  a  com¬ 
petitive  environment  where  Service  instal¬ 
lation  managers  and  weapon  system  pro¬ 
gram  managers  can  choose  whether  to  buy 
their  logistical  support  from  DLA,  from 
government  providers  within  their  Ser¬ 
vices,  or  directly  from  contractors.  The 
agency  has  reduced  logistics  response 
time  from  36  days  to  18  days  from  1998 
to  2000,  and  it  aims  to  achieve  9  days  by 
2005  (Defense  Logistics  Support  Com¬ 
mand,  2000).  Similarly,  it  is  on  its  way  to 
reducing  operating  costs  by  25  percent  and 
workforce  by  30  percent  over  the  same 
period.  In  order  to  achieve  these  improve¬ 
ments  DLA  has  reengineered  many  busi¬ 
ness  processes,  often  outsourcing  activi¬ 
ties.  It  has  made  use  of  A-76  competitions 
at  distribution  and  supply  depots.  Like  the 
Services,  DLA  committed  to  personnel  re¬ 
ductions  in  the  1998-2003  program. 

Cost  and  performance  measures  have 
made  some  contribution  to  DLA  sourc¬ 
ing  decisions.  Performance  measures  are 
in  place  throughout  the  organization.  For 
example,  timeliness  data  has  given  an  idea 
of  how  much  improvement  has  been 
gained  by  outsourcing  repair  parts  supply. 
DLA  has  been  working  on  cost  account¬ 
ing  since  1993,  although  it  does  not  yet 
have  a  full  ABC  system  in  place.  DLA 


"DLA  aims  to  be 
efficient  and  to 
achieve  perfor¬ 
mance  levels  that 
meet  customer 
needs." 
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performance  metrics  and  cost  accounting 
provide  a  context  for  sourcing  decisions, 
but  they  do  not  fully  inform  them. 

A  True  Revolution  in 
Defense  Business  Affairs 


OSD  has  initiated  a  “revolution  in  de¬ 
fense  business  affairs”  by  centrally  direct¬ 
ing  some  fairly  detailed  business  initia¬ 
tives  for  the  entire  department.  The  com¬ 
petitive  sourcing  campaign  has  succeeded 
in  that  it  was  based  on  the  correct  obser¬ 
vation  that  contractors  could  more  cheaply 
perform  many  functions  previously  per¬ 
formed  in-house  and  because  OSD  con¬ 
trols  the  budget  inputs.  However,  most 
effectively  integrating  contractors  into 
DoD  supply  chains  and  realizing  benefits 
of  outsourcing  beyond  cost  savings  will 
require  better  strategic  planning  and  per¬ 
formance  measurement,  not  just  more 
A-76  competitions. 

The  opportunity  exists  to  make  effi¬ 
ciency  a  management  objective  at  all  lev¬ 
els  of  DoD.  Strategic  planning  can  explic¬ 
itly  identify  the  outputs  needed  to  achieve 
defense  readiness  and  modernization  out¬ 
comes,  particularly  when  post-Cold  War 
strategy  shapes  a  force  more  for  needed 
capabilities  than  to  counter  a  specific 
threat.  The  generally  successful  effort  to 
measure  performance  across  organizations 
as  diverse  as  the  seven  DoD  GPRA  per¬ 
formance  measurement  pilots  shows  that 
the  outputs  can  be  quantified.  The  cost 
accounting  initiative  in  Army  Forces  Com¬ 
mand  installations  has  succeeded  in  iden¬ 
tifying  cost  drivers  and  highlighting  op¬ 
portunities  for  savings.  Navy  strategic 
sourcing  and  the  ongoing  business  reen¬ 
gineering  campaign  in  DLA  show  ways 
to  infuse  an  entire  Service  or  agency  with 


a  drive  for  efficiency.  Cost  accounting  and 
performance  measurement  could  influence 
the  programming-budgeting  process  by 
helping  to  identify  more  efficient  and 
effective  ways  to  conduct  defense 
operations. 

There  is  a  limit  to  what  efficiency  im¬ 
provements  can  accomplish.  Even  the 
roughly  $10  billion  in  savings  from  de¬ 
fense  competitive  sourcing  optimistically 
projected  by  the  DSB  study  is  not  enough 
alone  to  close 
the  DoD  mod¬ 
ernization  gap 
as  Cold  War 
legacy  systems 
need  replace¬ 
ment.  Desired 
outputs  of  qual¬ 
ity  of  life  or  lo¬ 
gistic  systems 
do  not  stand 
still  but  instead 
rise  with  time, 
so  improving  efficiency  can  mean  im¬ 
proving  output  at  constant  input  as  well 
as  reducing  cost.  Furthermore,  over¬ 
reliance  on  a  selected  few  measures  can 
distort  performance. 

Nevertheless,  accurately  measuring 
cost  and  performance  has  potential  to  im¬ 
prove  both.  Measurement  enables  setting 
standards  for  comparison  of  different 
sources  and  methods  of  providing  ser¬ 
vices.  DLA  management  is  taking  advan¬ 
tage  of  this  sort  of  information  in  its  drive 
for  efficiency.  When  cost  accounting  and 
performance  measurement  are  continuous 
and  routine,  then  analysis  to  support 
sourcing  decisions  will  be  easier,  more 
accurate,  and  less  subject  to  self-interested 
influence  than  ad  hoc  analyses.  Also, 
sound  strategic  planning  is  needed  to 


"Cost  accounting 
and  performance 
measurement  could 
influence  the  pro¬ 
gramming-budget¬ 
ing  process  by 
helping  to  identify 
more  efficient  and 
effective  ways  to 
conduct  defense 
operations." 
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identify  DoD  and  Service  core  competen¬ 
cies.  They  will  not  emerge  from  the  check- 
erhoard  results  of  individual  A-76  com¬ 
petitions  or  from  application  of  vague 
definitions  of  “inherently  governmental” 
functions. 

Motivation  is  a  vital  element,  too. 
While  perhaps  chafing  at  having  to  sub¬ 
mit  their  organizations  to  painful  A-76 
procedures,  the  Services  signed  up  on  the 
expectation  of  diverting  the  savings  to 
modernization.  The  most  recent  Air  Force 
budget  guidance  allows  major  commands 
to  retain  in  their  budgets  a  share  of  effi¬ 
ciency  savings  through  the  five  years  of 
the  defense  program.  DLA  is  motivated 
not  only  by  the  agency  performance  con¬ 
tract  with  OSD  but  also  by  its  ongoing 
competition  for  a  greater  share  of  the 
defense  logistics  mission. 

Redundancy  in  DoD  is  usually  justified 
as  reducing  risk,  but  it  can  actually  con¬ 
tribute  to  efficiency  if  accurate  account¬ 
ing  and  performance  measures  enable 
internal  customers  to  make  informed  com¬ 
parisons  among  competing  providers. 
DoD  cannot  take  advantage  of  the  effi¬ 
ciency  of  commercial  markets  by  one-time 
conversions  from  in-house  to  contract: 
competitions  and  recompetitions  must  con¬ 
tinue.  Only  with  comprehensive  strategies 


for  meshing  the  efforts  of  contractors, 
in-house  civilians,  and  military  units — 
together  with  knowledge  of  the  cost  inputs 
and  performance  outputs  of  each — can  the 
full  benefits  of  competitive  sourcing  be 
realized. 

Cost  accounting  and  performance  mea¬ 
surement  systems  in  DoD  have  been  im¬ 
mature,  so  OSD  leaders  had  few  alterna¬ 
tives  in  the  short  term  to  the  focused  di¬ 
rection  of  business  improvements.  In  fact 
the  measurement  systems  described  here 
have  required  years  of  effort  to  reach  their 
current  level  in  the  selected  organizations. 
Even  with  the  assistance  of  modern  in¬ 
formation  systems,  establishing  them  re¬ 
quires  major  management  investment  and 
cultural  change.  Yet  in  each  case  they  have 
contributed  substantially  to  improved  per¬ 
formance.  Existing  legislation  like  GPRA 
and  the  CEO  Act  along  with  OSD  direc¬ 
tives  already  mandate  modem  manage¬ 
ment  in  DoD,  but  achieving  the  reality 
takes  more  than  legislation  and  directives. 
Defense  leaders  need  to  emphasize  and 
resource  the  continuing  long-term  efforts 
and  knit  together  the  various  initiatives  in 
order  to  establish  efficiency  as  a  conscious 
goal  of  every  defense  organization.  That 
would  truly  revolutionize  defense  business 
affairs. 
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